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Abstract 

For matrix games we study how small nonzero probability must be used in 
optimal strategies. We show that for n x n win-lose-draw games (i.e. (—1,0, 1) 
matrix games) nonzero probabilities smaller than n"*^*-"' are never needed. We 
also construct an explicit n x n win-lose game such that the unique optimal 
strategy uses a nonzero probability as small as n^^'"'. This is done by con- 
structing an explicit (—1, 1) nonsingular n x n matrix, for which the inverse has 
only nonnegative entries and where some of the entries are of value nP^"\ 

Keywords: Matrix Games, Ill-conditioned Matrices, Nonnegative Inverse. 

1 Introduction 

Given a matrix game A we are interested in the following question: What is the 
smallest nonzero probability that must be used in optimal strategies. This quantity, 
the smallest nonzero probability of a strategy, was first considered in the context of 
recursive games (stochastic games where payoffs are only accumulated in absorbing 
states) by Everett [1]. To be more precise, if p is the smallest nonzero probability 
of a probability vector ct, we say that the patience of a is I /p. Note that this is the 
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precisely the expected number of times that a must be sampled in order to observe 
the least likely outcome. Also [log2(l/p)] is a lower bound on the number of random 
bits required in order to sample from a using a source of uniform random bits. 

In this paper we study the patience required for playing optimal strategies in matrix 
games. Our focus is how this quantity depends on the dimensions of the matrix game, 
rather than on the individual payoffs. In particular we consider win-lose and win-lose- 
draw matrix games. We model win-lose games as (0, 1) matrices and win-lose-draw 
matrices as (—1,0, 1) matrices. Note that for win-lose games this choice of matrices 
have no consequence: the set of optimal strategies is invariant under addition by 
a number and multiplication by a positive number, applied simultaneously to every 
entry of the matrix. In particular, we can equivalently model win-losc matrix games 
as (—1,1) matrices. 

We prove both upper and lower bounds on the patience required for playing optimal 
strategies for these two classes of matrix games. Our lower bounds build on previous 
constructions of ill-conditioned matrices [51[T]. In particular we show that from any 
ill-conditioned matrix A, a matrix game can be derived with patience at least the 
size of the largest entry of the inverse of A. As such our question can be seen as 
yet another application of ill-conditioned matrices. A downside of this connection is 
that it is not explicit - namely, we do not know of a polynomial time algorithm for 
computing this derived matrix game, given the ill-conditioned matrix A as input. We 
address this unsatisfactory situation by constructing a variant of the ill-conditioned 
matrix constructed by Alon and Via [T] , and study in detail the structure of the inverse 
matrix. Wc use this to construct an ill-conditioned (—1, 1) matrix with a non-negative 
inverse, and from this we directly obtain an explicit construction of a win-lose matrix 
of high patience. This construction is in fact what we will call fully- explicit, meaning 
that each entry of the matrix can be computed in time polynomial in the bitlength of 
the dimension of the matrix. 

Patience behaves very differently in matrix games compared to its original setting 
of recursive games [TTl |9l [T0| . First of all in recursive games optimal strategies are not 
guaranteed to exist; On the other hand, for every e > both players have stationary 
strategies guaranteeing an expected payoff within e of the value of the game from any 
starting position However, there exist recursive games with N positions, each with 
TO > 2 actions, and every payoff is or 1, where any (1 — 4TO~^/^)-optimal strategy 
must have patience at least 2™" ^ . On the other hand, patience (l/e)™"'"' is always 
sufficient for having an e-optimal strategy in recursive games where every payoff is 
or 1. 

Consider now again the setting of matrix games. Lipton and Young proved that 
in a zero-sum n x n matrix game where all payoffs belongs to the interval [0, 1], each 
player has a simple strategy guaranteeing an expected payoff within e of the value of 
the game, where a simple strategy is a strategy that mixes uniformly on a multiset of 
[Inn/e^] actions [TS]. Thus the patience of such strategies is also at most [Inn/e^]. 

In other words, comparing with our results below, if one is willing to give up e payoff, 
one can play with patience that is smaller by an exponential magnitude than required 
for playing truly optimally. 
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1 Introduction 

1.1 Our Results 

For stating our results we use standard matrix game terminology. We refer the reader 
to Section [5] for explanations of this terminology. 

We define the patience of a strategy to be 1/p, where p is the smallest nonzero 
probability the strategy x assigns to one of the actions. That is, the patience of a 
strategy x is (min{xi | Xi > 0})~^. 

Given a matrix game A, we define the patience t^{A) required for Player 1 to play 
A optimally to be the minimum patience of an optimal strategy for A. In a similar 
way we can define for Player 2. 

We are interested in the largest patience required for optimal strategies of win- 
lose and win-lose-draw games, as a function of the size of the matrix game. Thus, 
define T^i{n) as the maximum of t^{A) taken over all (0, 1) n x n matrix games A, 
and similarly Twid('T-) as the maximum of t^{A) taken over all (—1, 0,1) n x n matrix 
games A. 

Clearly the definition of T^i{n) and r^idin) would be unchanged by considering 
T^{A) rather than t^{A). However we shall also consider the patience required by 
both players for optimal strategies. Thus, we define also f^i{n) as the maximum of 
min(T^ (A), r^(A)) taken over all (0, 1) n x n matrix games A, and similarly Tjdd(n) 
as the maximum of min(T^(A), t^(A)) taken over all (—1,0, 1) n x n matrix games A. 
All these measures of patience are in fact closely related (cf. Section 12. 3p . 

We are now able to state our results. First using a Theorem of Shapley and Snow [5D] 
and standard estimates of the magnitude determinants we obtain the following basic 
upper bound on patience. 

Proposition 1. 

Next, using previous results on ill-conditioned matrices by Alon and Vu [1] we obtain 
the following (non-explicit) lower bound on patience. 

Theorem 2. 

f^d(r^)>nt/2"(2+o(i)) _ 

By Corollary [TS] from Section 12.31 we obtain a result for win-lose matrix games as 
well. 

Corollary 3. 

^i{n) > nf/2"(5/4+°(i)) . 

Our main contribution is an explicit construction of a matrix game satisfying a 
similar patience lower bound. 

Theorem 4. Let n — 2™ be a power of two. Then 

r™i(")>"^/2"''+°<'^' . 

Furthermore there is an algorithm that for each n and given indices i and j computes 
the entry {i,j) of the matrix witnessing the lower hound, in time polynomial in m. 
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1.2 Organization of the paper 

In Section [2] wc briefly introduee sign patterns of matrices and matrix games, followed 
by a more extensive coverage of patience of matrix games in Section 12.31 In particular 
this section provides a proof of the upper bound on patience of matrix games, Proposi- 
tion [TJ In Section [3] we consider the relationship between ill-conditioned matrices and 
patience of matrix games. In Section |4] we consider three easy examples of explicit ill- 
conditioned matrices and show how they give matrix games of large patience. Finally, 
in Section [S] we present our main contribution, an explicit construction of a win- lose 
matrix game of almost worst case patience. 

2 Preliminaries 

We shall denote by 1 a vector of appropriate dimension where every entry is 1. All 
vectors we consider are column vectors. 

2.1 Sign Patterns of Matrices 

A full sign pattern is a matrix with entries from {—1,1}. A pair of vectors 

with entries from { — 1, 1} gives rise to a full sign pattern cr'^^^ (cr'^^^)^ We shall call a 

full sign pattern of this form a block checkerboard sign pattern. 

Let A = (aij) he a n x n matrix with real valued entries. We say that A weakly 
obeys a block checkerboard sign pattern if there is a block checkerboard sign pattern 
E = (cTij) such that aij = 1 implies aij > and (Jij = — 1 implies Uij < 0. Note that 
given A, S is not necessarily unique, depending upon the entries of A that are 0. 

Lemma 5. Let A = (aij) be a nx n nonsingular matrix with real valued entries, such 
that the inverse A~^ weakly obeys a block checkerboard sign pattern S = (cTij). Define 
the nx n matrix B = Ao to be the Hadamard product of A and the transpose of S 
(That is, B = (bij) is given by bij ~ aijOji). Then the entries of the inverse B~^ are 
non-negative. 

Proof. This follows immediately by considering the identity AA^^ = /. □ 

2.2 Matrix Games 

A matrix game is given by a m x n real matrix A = (a^ ). The entries a.y are 
payoffs. The game is played by Player 1 selecting an action i G {1, . . . , m} and Player 
2 simultaneously selecting an action j € {!,..., n}, after which Player 1 receives a 
payoff of aij from Player 2. A strategy of a player is a probability distribution over the 
actions of the player. We shall view these as stochastic vectors. A strategy is totally 
mixed if it assign non-zero probability to each action. 

Given a strategy x for Player 1 and a strategy y for Player 2, the expected payoff to 
Player 1 when the two players use the pair {x, y) of strategics is x^Ay. The celebrated 
minimax theorem of von Neumann j23j states that every matrix game has a value. 
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Theorem 6 (von Neumann). For any matrix game A, there is a number v such that 
V = max minx^ Ay = niin max x^ Ay , 

X y y X 

where x and y range over strategies for the two players. The number v is called the 
value, va\{A), of A. 

A strategy x is a maximin strategy for Player 1, if minyX~^Ay = val(A). Similarly, 
a strategy y is a minimax strategy for Player 2, if max^: x^ Ay = val(A). We will call 
both a maximin strategy for Player 1 and a minimax strategy for Player 2 for optimal 
strategics. 

Shaplcy and Snow [5D] characterized the set of optimal strategies as the convex hulls 
of basic solutions. 

Theorem 7 (Shapley and Snow). Let X and Y be the sets of optimal strategies for 
Player 1 and Player 2 in a matrix game. Then X and Y are the convex hulls of the 
sets of basic solutions X* and Y* , where every pair of basic solutions x € X* and 
y G Y* correspond exactly to a square submatrix B of A, which satisfies: 

Ya\{A) = det{B)/l^ aA]{B)l , 

4 = lTadj(B)/lTadj(i3)l , (1) 
= adj(B)l/lTadj(B)l , 

where Xb and ys are obtained from of x and y by restricting to the rows and columns 
of B, respectively. 

If the value v of the matrix game A is nonzero this simplifies to 

val(.4) = , x1 = vi^B-^ , ys = vB-^ , (2) 

Conversely, we have the following result (see e.g. [HI Theorem 3.2]). 

Theorem 8. Let A be any. n matrix game, where A is nonsingular and l^A^^l 7^ 0. 

Define 

v^l/l^A-^1 , x'^ =vl^A-^ , y^vA-'^l . 

If both 2; > and y > then val(A) = v and x and y are optimal strategies of A. If in 
fact both X and y are totally mixed, i.e. a; > and y > 0, then x and y are the unique 
optimal strategies. 

2.3 Patience of matrix games 
Basic Relations 

Directly from the definitions we have: 
Proposition 9. 
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Conversely we can from matrix games where one player must use a strategy of high 
patience construct a (larger) matrix game where this is the case for both players. 

Proposition 10. Let A be a nx n (0,1) matrix game sueh that < val(A) < 1. Then 
there exist a 2n x 2n (0, 1) matrix game B such that f^i(B) > m.aji{T^ {A) ^ {A)) . 



Proof. Consider the 2n x 2n matrix game B given by 

B 



A 
11^ - A'^ 



Note that val(ll^ — A'^) = 1 — va\{A) > 0. It follows that the optimal strategies for 
Player 1 in i? arc of the form ((1 — val(A))x^, val(A)y^) and similarly the optimal 
strategies for Player 2 in B are of the form ((1 — val(A))y^, val(A)a;^) , where x and y 
are optimal strategies in A for Player 1 and Player 2, and the result follows. □ 

We have a similar statement for win-lose-draw matrix games. 

Proposition 11. Let A be a nxn (—1, 0, 1) matrix game such that —1 < va\{A) < 1. 
Then there exist a 2nx2ri, (— 1, 0, 1) matrix game B such that f^i{B) > max(r^(j4), t'^{A)). 

Proof. The proof follows similarly to that of ProoositionlTOl by considering the 2n x 2n 
matrix game B given by 

A -11^1 
-llT -AT 



B = 



and noting that this matrix game has the same optimal strategies as the matrix game 
obtained by adding 1 to each entry: 

A + llT 
11^ - AT 



val(A + llT) = val(A) + 1 > 0, and val(llT - A^) = 1 - val(A) > 0. 



□ 



Since a win-lose matrix game of value or 1 as well as a win-lose-draw matrix game 
of value —1 or 1 has trivial patience 1 for both players we have the following relations, 
complementing Proposition [S] 



Corollary 12. 



Q(2n) > T„;(n) , 7\^(2n) > T^id{n) 



Next we consider the relationship between win-lose and win-lose-draw games. Im- 
mediately from the definition we have. 



Proposition 13. 



We next show how to convert win-lose-draw matrix games into win-lose matrix 
games. 
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Proposition 14. Let A be a n x n (—1,0, 1) matrix game. Define the 2n x 2n (0, 1) 

matrix game B obtained from A by replacing (—l)-entries by the 2x2 all-zero matrix, 
0-entries by the 2x2 identity matrix, and 1-entries by the 2x2 all-ones matrix. Then 
T^{A) < T^{B) and t^[A) < t^{B) 

Proof. Let x' be an optimal strategy for Player 1 in B. Define the strategy x for 
Player 1 in ^ by a;^j_i +a:^2i- % definition wc have {x'''' {2B-ll^))j = 2{x''^B)j - 
1 > 2val(B) - 1 for all j. We then get 

(x^A), = \{x'\2B llT))2,_i + \{x'\2B llT))2, 

> i(2val(B) - 1) + i(2val(B) - 1) = 2val(B) - 1 

Similarly, for an optimal strategy y' for Player 2 in _B we define the strategy y for 
Player 2 in A by = y2i-i + v'li obtain {Ay)i < 2 val(i3) — 1 for all i. It follows 
that val(yl) — 2 val(_B) — 1 and x and y are optimal strategies in A. Since the patience 
of X is at most the patience of x' and the patience of y is at most the patience of y' 
the result follows. □ 

Wc then immediately have the following converse to Proposition 1131 

Corollary 15. 

Twid{n) < T„i(2n) , rZuiin) < Q(2n) . 



Patience Upper Bound 

Let ^ be a ri X n matrix game with integer entries. We shall make use of Equation (1T]0. 
Let _B be a m X m submatrix of A corresponding to an optimal strategy x of Player 



1. Define the auxiliary (m + 1) x (m + 1) matrix M 



IT- 

1 B 



Computing the 



determinant of M by expanding along first column and then the first row we find that 
det(M) = — l^adj(B)l. Since the entries of adj(i3) arc integers, by Equation ([T|) we 
have that either Xi = or Xi > l/|det(M)|. We may thus bound the patience of x by 
|det(A'f)|. 

Now, in case ^ is a (0, 1) matrix game, the matrix M is a (0, 1) matrix as well, of 
dimension at most (n + 1) x (n + 1). A bound of Faddeev and Sominskii [5] then gives 
|det(Af)| < (ri + 2)T^/2"+i. 

Similarly, in case ^ is a (—1, 0, 1) matrix game, the matrix M is a (—1, 0, 1) matrix 
as well, of dimension at most (n + l) x (n+l). and using the Hadamard bound we get 
|dct(S)| < (n + 1)^. Comb ining these, the proof of Proposition [T] follows. 



Alternatively one could do essentially the same derivation using the standard formulation of matrix 
games as linear programs. 
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3 Patience and Ill-conditioned Matrices 

From Theorem |8] we see that a nonsingular n x n matrix A with l^A^^l ^ defines 
a matrix game of patience at least 1^A~^1, provided that both l^A^^/l^A^^l > 
and A~^l/i^A~^l > 0. 

For a non-singular n x n matrix A, let B ~ A^^ ~ (bij) and define x(A) = 
maxij \bij\. The problem of constructing (0, 1) or (—1, 1) matrices A for which x(^) is 
large was considered first by Graham and Sloane [8] , and later by Alon and Vii [1] . Such 
matrices have besides the direct application of constructing ill-conditioned matrices, 
several applications such as flat simplices, coin weighing, indecomposable hypergraphs, 
and weights of Boolean threshold functions [HI HH HI HZl H] • 

Define Xi{n-) a-s the maximum of x(A) over all non-singular nxn (0,1) matrices 
A. Define X2{n) to be the analogous quantity where (—1, 1) matrices are considered 
instead. Alon and Vii [1], building on the techniques of Hastad, gave a near optimal 
construction of ill-conditioned matrices. More precisely they provide for every n an 
explicit n x n (0,1) matrix Ai and an explicit n x n (—1,1) matrix A2 such that 
xi-^i) ^ n"/^/2"(^+°(^^' for i — 1,2. When n is a power of 2 these lower bounds 
may be improved to n"/^/2"(^+°'^)). Upper bounds for Xi(n) are derived from the 
Hadamard inequality. 

Theorem 16 (Alon and Vii). 

nt/2"(2+o(i)) < ^.(n) fori = 1,2 
Xi(n) <7it/2"-i 
X2(n)<(n-l)^/2"-i 

In their application to indecomposable hypergraphs, Alon and Vii construct a non- 
singular (0, 1) n X n matrix D such that y = D~^l > and \yi/y2\ > /2"(^+°(^)^ 
Unfortunately this construction does not ensure that also 1^D~^ > 0, and hence we 
cannot use it to give a matrix game of large patience as described above. 

It does however turn out that any matrix A with large x(^) can be used to construct 
a matrix game with patience x(^)j as will be explained in the following section. 

3.1 The Matrix Switching Game 

Let B be any nxn matrix. We call the operation of flipping all the signs of an entire row 
a row switch, and similarly the operation of flipping all the signs of an entire column 
a column switch. We are interested in the sum of all entries, l^B'l, for matrices 
B' obtained from B using row and column switches. The matrix switching game for 
B is to find such a matrix B' maximizing l^B'l, the value of the switching game. 
Equivalently we may view the matrix switching game as the problem of maximizing the 
bilinear form By over x,y G {—1, 1}". The special case of matrix switching game 
for (—1,1) matrices is known as the Gale-Berlekamp switching game [22j Chapter 6] 
(or simply the Berlekamp switching game |21j). 
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Directly from the definition of the matrix switching game we have the following. 

Lemma 17. Let B he any n x n matrix, such that 1^ Bl can not be increased by a 
row or column switch. Then 1^ B > and Bl > 0. 

It is easy to see that the value of the matrix switching game is at least as large as 
the largest element of the matrix. 

Lemma 18. Let B = (6^^) be any n x n matrix. Then there exist x G { — 1, 1}" and 
y G { — 1, 1}" such that x^ By > maxij|6y |. 

Proof. Let bij be the entry of largest absolute value in B. First perform column 
switches in B to make all entries of row i non-negative. Next perform a row switch in 
any row where the sum of the entries of the row is negative. 

Thus the value of the game is at least ma.Xij\bij\. □ 

Proposition 19. Let A be a nonsingular (—1,1) nx n matrix. Then there exist a 
block checkerboard sign pattern S such that the (71 + 1) x + 1) (—1, 0, 1) matrix game 
B given by 



satisfies t'^{B) > x{A) and t'^{B) > xiA). 

Proof. Let x,y £ {—1, 1}" maximize the bilinear form x~^A~^y, and define E = xy~^ . 
Let C = Ao ET Then C"! = A-^ o S. By Lemma [13 we have I'^C'^ > and 
C~^l > 0, and by Lemma [TSl we have 1^C~^1 > x(^) > 0- Hence Theorem [5] gives 
v:=val{C) = l/l'^C-^l>0. 

Optimal strategies in B for Player 1 must then be of the form (w/(l + w),a;'^/(l + 
v)), and similarly optimal strategies in B for Player 2 must be of the form (u/(l + 
v),y'~^ /{I + v)), where x and y are optimal strategies in C for Player 1 and Player 2. 
It follows these are of patience at least {1 + v)/v > 1/v = 1^C~^1 > 

Combining this with Theorem gives the proof of Theorem [2] and Corollary [31 
While these bounds matches the patience upper bound of Proposition [1] up to the 
constant in the exponent, and in the case of win-lose-draw games in fact match up to 
an exponential factor, a drawback is that the matrices giving these lower bounds are 
not very explicit. We can formalize such a statement using computational complexity 
theory, by looking at the complexity of the computational task to compute the n x n 
matrix of the family, given as input the number n. 

The matrices constructed by Alon and Vii from Theorem [TCj are in fact very explicit 
in this sense as will be detailed in Section 15.81 Given such a matrix A, the proof of 
Proposition [TOj proceeds to invert A, and then solve the matrix switching game for 
A~^. While inverting A is a polynomial time computation (in n) it turns out that 
solving the Matrix Switching game is NP-hard [TH] (this is true even in the case of 
the Gale-Berlekamp game). This NP-hardness result is not a real obstacle though; 
all that is needed for the proof of Proposition [T9| to go through is that the vectors 
x,y Cz { — 1, 1}" describe a local maximum of the matrix switching game, in the sense 
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that the bilinear form A~-^y cannot be increased by changing a single coordinate of 
X OT y, and furthermore that the value of this local maximum is at least xi^)- We will 
discuss this issue of explicitness in more detail in the next section. 

3.2 Local Search and Bipartite Maximum Cut 

In this section wc will consider local search algorithms from the perspective of compu- 
tational complexity in order to properly discuss the explicitness of the matrix games 
of high patience constructed in the previous section. 

Johnson ct.al. |13j formalized the notion of polynomial time local search problems 
by the complexity class PLS. A local search problem P is specified by the following: 

• A set ^ of instances, given by a polynomial time algorithm that decides if a 
given string represents an instance of P. 

• For each instance x, a set .^(x) oi feasible solutions, whose elements are strings 
bounded polynomially in the length of x. 

• A specification of P as cither a maximization problem or a minimization problem, 
together with a cost measure c{x, y), for x' e and y e ^{x), to be maximized 
or minimized, respectively. 

• For each solution y G --^{x), a set .yy{x,y) of neighboring solutions. 

We then say that P is in PLS if there exist polynomial time algorithms A, M, and C 
as follows: 

• A, on input x G .y, produces a solution y G r^{x). 

• M, on input x €z ^ and y G --^(x), computes c{x, y). 

• C, on input x € ^ and y G -^{x), either reports that y is the best solution in 
^{x,y), or produces a better solution y' G ^{x,y). 

The standard algorithm to solve the problem P is to first run algorithm A, and then 
repeatedly run algorithm C until a locally optimum is found. 

We can cast the matrix switching game of the previous section in this framework, 
showing that the problem is in PLS: Instances are integer n x n matrices A. A 
solution is given by a pair of vectors x,y G { — 1,1}". The cost of a solution is x^ Ay, 
and neighbors of {x,y) are those obtained by hipping the sign of an entry in either x 
or y. Algorithms A, M , and C are immediate. 

We note that to implement the proof of Proposition [TH] one would need not only a 
locally optimum, but a locally optimum of a certain quality. We will suggest that it 
might be hard to even just find a locally optimum, or in other words solve the matrix 
switching game, without using specific knowledge of the input matrix A. 

Using the notions of reductions and completeness one may in a similar way to the 
theory of N P-completeness argue that certain problem in PLS are unlikely to be solvable 
in polynomial time. 
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A PLS-problem Pi is PLS-reducible [13] to another PLS-problem P2, if there are 
polynomial time computable functions / and g, such that / maps instances of Pi 
to instances of P2, g maps pairs {y',x), where y' is a solution of f{x), to a solution 
g{y' , x) of X, and in the case when y' is a local optimum of P2, then gly, x) is a local 
optimum of Pi. With the notion of reduction in place, we say that a PLS-problem P 
is PLS-complete, if every other PLS-problem reduces to P by a PLS-reduction. 

SchafFer and Yannakakis |19] found a number of natural local search problems to be 
PLS-complete. In particular they showed that the MaxCut problem is PLS-complete 
under the Flip neighborhood. Here the MaxCut problem is given as follows; In- 
stances are graphs G = {V,E), V = {1, . . . ,n}, with integer weights on the edges, Wij. 
Solutions are cuts {S, S), S CV, oi the vertices, and the cost of a solution is the sum 
of the weights of edges connecting vertices across the cut, X]yG(s S) '^^'^ Flip 
neighborhood is defined by the action of moving a single vertex across the cut. 

Letting Xi G {—1, 1} be given by = 1 if and only ii i G S, we see the MaxCut 
problem is equivalent to maximizing the quadratic form '^i^j Wij{l — XiXj)/2 over 
X E { — 1,1}". Conversely, the problem of maximizing a quadratic form x~^ Ax over 
X E { — 1, 1}" can be formulated as a MaxCut instance. 

Since, as we have seen, the matrix switching game is equivalent to maximizing 
a bilinear form over {—1,1}", it is not surprising that wc can also reformulate the 
matrix switching game as a maximum cut problem. 

Indeed, let A be any n x n matrix A, and x,y E { — 1, 1}". Then 



Define now the bipartite graph Ga = {Vi,V2,E), with Vi = {l,...,n} and V2 = 
{1', . . . , n'} , with an edge (i, j) whenever 7^ of weight Wij = —Uij. This forms an 
instance of the bipartite MaxCut problem, which is the restriction of the MaxCut 
problem to bipartite graphs. That is, solutions are cuts {S,S), S* C Vi U V2, of the 
vertices, and the cost of a solution is again the sum of the weights of edges connecting 
vertices across the cut, s) ^y- Letting = 1 if and only if i G S* and ?/i = 1 if 

and only if i' E S, this is exactly the quantity expressed in Equation ([3]). 

The bipartite MaxCut problem is NP-hard [1^1 [IB]- But as argued, the question 
relevant for us should be if the bipartite MaxCut problem is PLS-complete under the 
Flip neighborhood as well (observe that the Flip neighborhood corresponds to row 
and column switches in the corresponding matrix switching game). 

Despite our efforts, wc have not been able to resolve this question. On the other 
hand we have not been able to solve the problem in polynomial time either. Failing to 
prove the problem to be PLS-complcte does not a priori suggest that the local search 
problem might be easy. Actually, unlike the theory of NP-completcness, it is not rare to 
find local search problems that are neither known to be polynomial time solvable, nor 
PLS-complete. An important such example is the Travelling Salesman problem. 
Krentel showed the problem to be PLS-complete under the fc-OPT neighborhood (which 
is defined by the process of removing from a tour arbitrary k edges and reconnecting 
the k resulting pieces into a new tour), for sufficiently large k [T3|. It is still an open 




(3) 
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problem if the same is true for the simple 2-Opt and 3-Opt neighborhoods [19]. 

We are able to show a weaker statement about the bipartite MaxCut problem. 
Define the 2-Flip neighborhood by the action of moving up to 2 vertices across the 
cut. We then have the following hardness result. 

Proposition 20. The bipartite MaxCut problem is PLS-complete under the ^-Flip 
neighborhood. 

Proof. The result is proved by a simple reduction from the ordinary MaxCut problem. 
Let G ~ {V,E) with = {1, . . . , n} be a graph with weight w forming a MaxCut 
instance. Let M = 1 + J2ij\''^ij\- Define a bipartite graph G' = {Vi,V2,E') with 
weights w[j, as follows. We let Vi = {1, . . . , n} and V2 = {!', . . . , n'}. Vertices i and 
i' are joined by an edge of "huge" weight M. Whenever ij E E we join i and j' as 
well as i' and j by an edge of weight —Wij. We thus let /(G, w) = (G", w') be the first 
function of the reduction. 

First, observe if a given cut (S", S') of the vertices of G' docs not satisfy i S S" if 
and only if i' e S\ then the weight of the cut can be improved by moving either of i 
or i' to the other partition of the cut. We will thus in the following calculation assume 
that this is not the case for any i. Now a cut (S' , S') of G' induces a cut (5, S) of G 
defined by i <E 5 if and only if i G S' . We then have 

w'iS',S') = nM+ E_"^^'. ="^^ + 2 

= nM - 2 ^ Wij = {nM - 2 ^ w,y ) + 2 ^ w.,j 

From this we see that w{S,S) = w'{S',W)/2 + (X;^ - nM/2). 

We can thus simply define the last function g of the reduction as g{S' , S') = (5*, 5*). 

□ 

Remark. One can observe that the reduction above in fact satisfies the notion of 
being tight as defined by Schaffer and Yannakakis [TH]. We will not define the notion 
here, but just remark that it implies that the reduction gives a number of additional 
results besides showing PLS-completeness. For instance it implies that the standard 
algorithm must take exponential time in the worst case. And this is true no matter 
how the neighbors are chosen in each step of the local search procedure. 

4 Explicit Examples of Exponential Patience 

In this section we give several examples of matrix games that requires exponential 
patience. All of the examples are special Toeplitz matrices, that were constructed 
earlier for the purpose of studying ill-conditioned matrices [S] and extremal matrices 
with respect to the determinant 0. Here a nx n matrix A = (oij) is called a Toeplitz 
matrix, if every left-to-right descending diagonal of A is constant, i.e. Oij = fti+i 
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for all i and j. We may thus specify A by the 2n 
We shall use the notation 



1 numbers a 



A = T(a„,i . . . a2,iQi,iai,2 ■ • ■ 

with the upper left element of A underlined. 

For all the examples we use Theorem|5]to compute the patience. For the first matrix 
we can do this directly, whereas for the last two examples we need to go via Lemma [SJ 
using that the inverse of the matrices turn out to weakly obey block checkerboard 
sign patterns. This in turn gives rise to win-lose-draw matrix games, whereas the 
first matrix give rise to a win-lose matrix game. These n x n win-lose-draw matrix 
games can be converted to 2n x 2n win-lose matrix games of the same patience using 
Proposition 1141 but we can do better in these examples using the tight connection 
between n x n (0, 1) matrices and (n+ 1) x (n + 1) (—1, 1) matrices, we describe next. 
Let A be a 71 X n (0, 1) matrix. Then define a (n + 1) x (n + 1) (—1, 1) matrix ^{A) by 



2/1- 11^ 



(4) 



If A is invertible then ^{A) is invertiblc as well and we have (cf. [T]) 



2-1^^-11 -l^A-i 
A-^1 



4.1 (0,1) Hessenberg matrix 

Ching [3] considered the following Hessenberg- Tocplitz matrices. For given n define 
the nxn matrix _D„ — (dij) by dij^k = 1 if fc G { — 1,0,2,4,...} and di^i-k = 
otherwise. Alternatively, = T(0101 . . . 10110000 . . . ). 

It was shown by Ching that for any n x n (0, 1) Hessenberg matrix A„ (i.e. An 
is a triangular matrix except that the diagonals above and below the main diagonal 
may also be nonzero) with n > 2 satisfies |det(A„)| < det(Z)„). We remark however 
that the matrix Z?„ is actually the transpose of the upper-right nxn submatrix of 
the matrix T„+i, defined by Graham and Sloane, that we will consider in the next 
subsection. Also, in fact Graham and Sloane already obtained the result of Ching 
while showing properties of T„ (see [S], Lemma 9). 

For us, however, the matrix Z?„ has the advantage over the other examples we 
consider, that it directly gives a matrix game where the optimal strategics arc totally 
mixed. 



Example. 



110 
110 
10 110 
10 11 
10 10 1 
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Let Fn denote the nth Fibonacci number, given by F„ = F„_i + f„_2 for n > 2, 
Fi ^ F2 = I, and Fq = 0. Alternatively 

F„ = (^"-(l-^)")/V5 , 

where (p = {1 + \/5)/2 = 1.61803... is the golden ratio. 

We shall not compute the inverse of but just determine the information needed 
to apply Theorem [S] We can determine a recurrence for the determinant of D„ by 
expanding along the first row, and obtain det(£'„) = det(£'„_i) + det(Z)„_2) for n > 2. 
Also det(Di) = det(L'2) = 1, and hence det(D„) = F„. Similarly, one may easily verify 
the following. 

Lemma 21. Let x, y G M" be defined by Xi = ijn-i+i ~ Fi/Fn for i < n and Xn = yi = 
Fn^2/Fn- Then x^ = 1^ and = 1. Also X^Li = SLi Vi = i'^^n - l)/F„, 
and hence l"^D;:^l = (2F„ - 1)/F„. 

From this and Theorem |S] we immediately obtain a statement about the matrix D„ 
viewed as a matrix game. 

Proposition 22. The matrix game £)„ has value v — _F'„/(2i^„— 1) and unique optimal 
strategies x and y for the two players, where Xi = yn-i+i = Fi/Fn for i < n and 
Xn =2/1= vFn~2l Fn- In particular we have Xi = yn = l/(2i^„ — 1), and the patience 
of both X and y is precisely 2Fn ~ 1, and asymptotically Q{ip''^). 

4.2 Triangular matrix 

Graham and Sloane [S] defined the following triangular matrices. For given n define 
the nx n matrix i„ = (ty) by t^.i+fe = 1 if A: e {0, 1, 3, 5, ... } and ti^i^k ~ otherwise. 
Alternatively i„ = T(0 . . . 01101010 . . . ). 

Example. 
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1 
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As pointed out by Graham and Sloane, the inverse of t„ is again a triangular Toeplitz 
matrix, namely 

=T(0,..., 0,1,-^^1, F2,-f^3,...,(-l)""'i^n-l) . 

This means that t~^ weakly obeys the (block) checkerboard sign pattern S„ = (cTij) 
given by o-y = (-1)'+^. We thus have that the matrix = t„oI] = T(0. . .0, 1, -1,0,-1,0, -1,0 . . .) 
has inverse T(0, . . . , 0, 1, i^i, F2, . . . , F„_i). 
One may now easily verify the following. 
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Lemma 23. Let x,y € M" be defined by Xi = j/n-i+i = ^i+i • Then x tn = 1 and 
t„y = 1. Also X;r=i ^» = 1]"=! = 1 = - 2. 

And from Theorem [8] wc obtain the following. 

Proposition 24. T/ie (—1, 0, 1) matrix game Z„ has value w = 1/ (i^„_|-3 — 2) and unique 
optimal strategies x and y for the two players, where Xi = yn—i+i = Fi+i/{Fn+3 — 2). 
In particular we have Xi = y„ = l/(i^„-)_3 — 2), and the patience of both x and y is 
precisely — 2, and asymptotically fi((p"). 

Wc next derive a win- lose matrix game of similar patience using Equation Q . Define 
a vector / and its reverse fa by 

/ = ((-l)"-2^^„_2,...,-Fi,Fo,-l)T 

fR = {-l,Fo, -Fi, . . . , (-ir-2^„_2r ■ 

One may verify that the inverse of is then given by 



-f tn' 



and we see that <i>(t„)~"'^ weakly obeys the similar (block) checkerboard sign pattern 
— E„+i. Thus the matrix i'„ = $(t„)~^ o (— I]„+i) has a non-negative inverse. 
One may now easily verify the following. 

Lemma 25. Let a;, y G K"'''"'^ be defined by xi ~ j/n+i — Fn-i, and Xi ~ yn-i+2 = 
F,-i, for I > 2. Then x'^f,, = 1^ andf „y = 1. Also x, = ^^=1' = l^^^n'l = 

Fn-l + Fn+2 — 1- 

And from Theorem |5] we obtain the following. 

Proposition 26. The (—1, 1) matrix game t'n has value v = l/(i^„_i -f i^„4-2 — 1) and 
unique optimal strategies x and y for the two players, where xi = yn+i = Fn-i/(-Fn-i + 
Fn+2 - 1) and Xi = yn-i+2 = Fj_i/(F„_i + F„+2 - 1), for i>2 

In particular we have x-j = J/n+i = -|- — 1), and the patience of both x 

and y is precisely Fn-i + Fn+2 — 1; and asymptotically ri((p"). 



4.3 Toeplitz matrix 

Graham and Sloane [5] additionally defined the following Toeplitz matrices. For given 
n define the n x n matrix T„ = (tij) by ti^i-k = 1 if fc G {—3,-1, 0, 3, 4, 6,7,.. .} and 
ti^i-k = otherwise. Alternatively T„ = T(. . . 11001100110100000 . . .). The inverse 
of Tn was computed by Graham and Sloane using Trench's algorithm, and is described 
below. 

Define sequences {pn} and {qn} of integers by 50 = 0, po — Qi — I2 — 1, and 
inductively 

Pn Pn-l + qn-l , forn > 1 , 
Qn = qn-l +Pn-2 , for 71 > 3 . 
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From these definitions one may determine their asymptotics as Pn,qn = ^{p^), where 
P3 = 1.75488... is the largest root of - 2x^ + x - 1. 

It turns out that the inverse of r„ is symmetric about the top-right to bottom-left 
diagonal and of the following form. 



Tr 





" -1 
1 

-1 


-V2 

qi 

-92 


-P3 ■ ■ 
92 ■ • 
-93 ■ • 


• ~Pn-4 
qn-5 
■ —qn-4 


~Pn-3 
qn-4 
-qn-3 


qn-2 
-Pn-4 
Pn-3 


-qn-^L 

Pn-5 
-Pn-4 


Pn-2 

-qn-^L 

qn-2 


1 _ 


1 


pi 


P2 ■ ■ 


Pn-5 


Pn-4 


-qn-3 


qn-4 


-Pn-3 







1 


Pi ■ ■ 


Pn-6 


Pn-5 


— qn-4 


qn-5 


-Pn-4 










1 . . 


Pn-7 


Pn-6 


— qn-5 


qn-6 


-Pn-5 



Note that r„ ^ weakly obeys the block checkerboard sign pattern 
S = (-1,1, -1,1,..., 1)(1,...,1, -1,1,-1)^ . 

By Lemma [5] the matrix r„ = T„ o has as inverse a matrix with all entries being 
non- negative. We only give an asymptotic lower bound on the patience of r„. 

Proposition 27. The (—1,0, 1) matrix game Tn has unique optimal strategies x and 
y for the two players each of patience Q{p^). 



Proof Note that I^tJi 



n{p^) = nip^), (l'T„ )i = (r„ 1)„ = 4. Using Theo 



rem[5]we have that xi = yn = l/fl{p'^), and the patience of x and y is il{p^). 



□ 



Again we may derive a win- lose matrix game of similar patience using Equation 
Define a vector g and its reverse gu by 

5 = (1,0,1,0,. ..,0)T 

= (0,..., 0,1,0, 1)T . 

One may verify that the inverse of $(T„) is then given by 



$(r„)'i 



1 



-9l 



and we see that <I>(T„) ^ weakly obeys the similar (block) checkerboard sign pattern 

S' = (1,-1, 1,-1,1,..., 1)(-1,1,..., 1,-1, 1,-1)^ . 

Thus the matrix T'n = $(T'„)^^ o S' has a non-negative inverse. We then have the 
following. 

Proposition 28. The (—1, 1) matrix game T'n has unique optimal strategies x and y 
for the two players each of patience Q{p^). 

Proof Note that l^T'^.h ^ n{p„) = 17 (pg), il^T^^)i = (T,;4)i 1. Using Theo- 
rcm[5]we have that xi — yi ~ l/i}{p-^), and the patience of x and y is ^^(ps). □ 

Tin [8] this entry is incorrectly written 
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5 Explicit matrices of almost worst case patience 

In this section we present the proof of our main result, Theorem|4l The overah strategy 
for the proof is similar to the last examples of Section Namely for any n = 2™, we 
first construct a non-singular n x n (—1, 1) matrix A for which x(^) ^ "-^ /2"'-'^+°(^)). 
This matrix is a specific instance of the ill-conditioned matrices constructed by Alon 
and Vii [T] . This immediately means that the inverse of A has an entry of magnitude 
/2"(^+°^^^' by the analysis of Alon and Vii (or alternatively it is easily derived from 
the more involved analysis of this section). But just as important for us, the specifics 
of our construction allows us to show that A~^ weakly obeys a block checkerboard sign 
pattern S. Using Lemma[5]this means that the (—1, 1) matrix B = (bij) = Ao has 
a non-negative inverse. We can then apply the result of Shapley and Snow to analyze 
the patience of the matrix game B. Specifically by Theorem |S1 the matrix game B 
has unique optimal strategies x and y. In particular the strategy x is given by 

x'^ ^l^B-^/l'^B-H . 

In Section [5.4.1l we compute the first column of A^^ and from this analysis we find 

n 

ba = -(1 - m/2) + to/2 = to - 1 . 

i=l 

Since B'^ is non-negative we also have I'^B'^l > x(A) > nt/2"(i+°(i)). Thus the 
patience of B is at least /2"(^+°(^)^ as well. 

The rest of the section is organized as follows. In Section [Ql we review the details 
of the construction of Alon and Via. In Section 15.21 we define the specific instance of 
this construction that we will use. In Sections 15.31 and the following three sections we 
show that the matrix weakly obeys a specific block checkerboard sign pattern. Finally 
in Section [5^ we give a sketch of the proof that our construction is fully explicit. 

5.1 The Alon-Vu matrix 

We review here the matrix construction of Alon and Via. Let n = 2™ be a power of 
two. Let ai, . . . , a„ be an ordering of the n subsets of [to] that satisfies 

• \ai\ < \ai+i\ 

• \ai A tti+il < 2. 

Such an ordering was shown to exist by Hastad [12] . In Section 15.21 we will construct 
a particular such ordering. Define for convenience ao = 0- Given the ordering we 
define a n x n (—1, 1) matrix A = (aij) by the following rules (for intuition behind 
this construction see jl2j). 

1. If aj n (ai-i U ai) = A ai and ja^^i A ai\ = 2, then a^j = —1. 

2. aj n (a,_i U ai) ^ 0, but case (1) does not occur, then a,j = (_i)l"i-iUail+i_ 
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3. If aj n (ai-i U Ui) = 0, then aij = 1. 

For analyzing the matrix, Alon and Via essentially considered a LQ decomposition 
of A. Define the (—1, 1) matrix Q = (g^) by = (— Then Q is a symmetric 
Hadamard matrix, — nl. 

For i > 1, define subsets Ai of [n] hy Ai = ai-i U a^, and from these, further define 
families Fi of subsets of [n] by the following rules. 

1. If \ai-i A ai\ = 2, then Fi = {as \ as C A.,, \as n (a^-i A a^l = !}■ 

2. If |a,_i A a^l = 1, then F., = {a^ C A,} 

Whenever la^l = fc we have \F,\ = 2^ for both cases. Next, define the lower triangular 
matrix L = (lij) as follows. Let In = 1 and lij = 0, for j > 1. For i > 1 we let 

r(i)'=-i-i ifj = ^-i 

hj^lC^)''-' ifa, ei^AK-i} ■ 

[O ifa, ^F, 

One can then verify the following. 
Lemma 29 ([1], Lemma 2.1.2). 

A^ LQ . 

5.2 The ordering. 

Here we construct a specific ordering of the subsets of [m] satisfying the requirements 
given in Section 15.11 We first construct separate orderings for the subsets of size k for 
every k. These will have the property that the first set in the order is the lexicograph- 
ically smallest set, i.e. {1, . . . , fc}, and the last set of the order is the lexicographically 
largest set, i.e. {m — fc + 1, . . . , to}. 

If /3 C [to] denote by {/3 + i) the subset of [m + i] defined by {f3 + i) = {j + i E 
[m + i] \ j € /?} (this definition makes sense also when /3 = 0, in which case the result 
is also 0). Let /3 = . . . , /3f) be an ordering of the subsets . . . , /3f C [to]. We 
denote by rev(/3) the reverse ordering rev(/3) ~ (/3f, . . . ,/3i). By (/3 + i) we denote 
the ordering {(3 + i) = + i), . . . , + i)). By {{i} U /3) we denote the ordering 
{{i} U /3) = (({«} U Pi), . . . , {{i} U (3i)). (These definitions make sense even if /3 is the 
empty list, resulting in the empty list as well). If f3' = (/3J , . . . , /3^,) is another ordering 
of different subsets, we denote by /3 o /3' the ordering f3o f3' = (/S^, . . . , (3i, (3[, . . . , /S'^,). 

The separate ordering for subsets of size k of [to] , is defined by induction on k and 
TO. Denote this ordering by /3^'. For fc = we have just the empty set 0, and hence 
f^ln — i^)- I^or convenience, define /3^'^ as the empty order /3,^^^ = (), when k > m. 

We now construct the ordering of subsets of size k of [to] for to > fc > 0. Assume 
by induction we have ordered the subsets of size fc — 1 of [to'] for all to' > fc — 1 . Then 
we define 

f3l^'> = ({1} U (/3|tl^ + 1)) ° ({2} U rev(/3(t2^ + 2)) o iol^l, + 2) . 
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We see the ordering begins with the first sets containing element 1, starting with 

the set {1, . . . ,k} and ending with the set {1, m — fc + 2, . . . , m}. Next follows the ("^1^) 
sets containing element 2 but not element 1, starting with the set {2,m — fc + 2,..., m} 
and ending with the set {2, . . . , fc + 1}. Finally follows all the C"^^) sets not containing 
the elements 1 and 2, starting with the set {3, . . . ,k + 2} and ending with the set 
{to — k + 1,...,to}. Wc note that between all these neighboring ending sets and 
starting sets the symmetric difference is exactly 2, and we have covered all (™) = 
(T-i ) ~^ (T-i^) ~^ ("fc"^) sets. By induction the ordering thus satisfies the requirement 
of symmetric differences being at most 2. Note that the first set is the lexicographically 
smallest set, and the last set is the lexicographically largest set. 

Example. For to = 4 we have the following orderings. 

(0) 

({1},{2},{3},{4}) 

({1,2},{1,3},{1,4},{2,4},{2,3},{3,4}) 
({1,2,3},{1,2,4},{1,3,4},{2,3,4}) 
({1,2,3,4}) 

Next, we construct the full ordering /3„ by combining all /3^' . First, for fc = 2 we 
define a shifted version of the ordering. Let £ — (™). Let /3^^ = {l3l^\, ■ ■ ■ , f3^\)- 

Then define (3^^^ = . . by p'^^], = {{3 - 1) mod to | j G /S^^'j. Having 

this shifted version of sets of size 2 will be critically used in our proof. Now we can 
finally define 

/3m = /3m ° /3m ° /3m' ° rcv(/3^) o o rev(/3^J o o • • • o /3™ . 

In other words, /3„j begins with the concatenation of /3"„, fi]^, and /3^-', after which 
the remaining orders /3j^„ are concatenated with [3^-^ reversed if k is odd. 

We now verify that the two properties the order must satisfy holds. Clearly the sets 
are ordered in nondecreasing size. We have already established the requirement about 
symmetric differences within each order of sets of a given size. We next consider the 
pairs of ending sets and starting sets. The first 3 such pairs arc (0, {1}), ({to}, {1, to}), 
and ({to — 2, to— 1}, {to — 2, to— 1, to}). In each case the symmetric difference is exactly 
1. The general case follows by recalling that each order starts with the lexicographically 
smallest set and ends with the lexicographically largest set, and every second order is 
reversed. 



/3f = 
/3f' = 
/3f - 
/3f = 

/3r = 
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Example. 

{1},{2},{3},{4} 

{4,1},{4,2},{4,3},{1,3},{1,2},{2,3} 

{2,3,4},{1,3,4},{1,2,4},{1,2,3} 

{1,2,3,4}) 

5.3 Sign pattern of the inverse of A 

In this section we let ai, . . . , a„ denote the particular ordering defined in Section [5.2l 
and we consider the construction of the matrix A from Section fS.ll witli respect to this 
ordering, together with the corresponding matrices L and Q, sets Ai, and families of 
subsets Fi. 

Definition 30. For a subset a C {1, . . . ,m} we let num(a) denote the unique j G 
{1, . . . ,n} such that a = aj. Define also ik = min{j : \aj \ = k}, for all k. 

We remark that does not depend on the particular order we consider, but is fully 
defined by the conditions of Section [O] 

We prove that the matrix A, for m > 2 has an inverse that weakly obeys a block 
checkerboard sign pattern. Namely we show that A^^ weakly obeys a sign pattern S 
of the following kind. 



E = 



-1 


1 


1 


-1 


-1 


1 


1 


-1 







The n rows are divided into m + 1 blocks. Block k corresponds to the subsets of size 
fc — 1, for k = 1, . . . , 771 + 1. That is, block k consists of the rows i for which \ai\ = fc — 1. 
The columns are divided into precisely two blocks. For m > 6, we in fact prove that 
the first block of columns is of size 2m — 1. Thus E = cr(i)(cr(2))"^, where 

2m — 1 ?i — 27n+l 

) = and af^) = ■ 

One may verify by hand that the matrices for m = 4 and m = 5 also weakly obeys 
this sign pattern. The matrices for m = 2 and m = 3 do not weakly obey this sign 
pattern, but the similar sign pattern where the columns are divided into two blocks 
of equal size. The matrix for m = 1 does not weakly obey a block checkerboard sign 
pattern. 

We prove this for the first column as a special case in Subsection 15. 41 The remaining 
columns we handle as follows. By Lemma we have A = LQ. Column j of A~^ is 
then the solution of the linear system 

LQx ~ Cj (5) 
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Defining z = Qx, we have tiie equivalent system 

Lz = ej (6) 

In Subsections 15.51 15. 6[ and 15.71 we prove tliat for j > 1 we liave \zn\ > J^^^il^il- 
Then, since x = '^Qz, by the definition of Q we have 

sgn(xi) = sgn(z„) 

Furthermore, we prove that z„ > for i < 2m, and z„ < for i > 2m, thus establishing 
the claimed sign pattern. Note that this latter part is not necessary to claim that 
weakly obeys a block checkerboard sign pattern. But proving this allows us to argue 
that the construction is fully-explicit. 

We will several times use the following simple facts. 

Lemma 31. Let wi > 1 and Wi^i > (2 + e)wi, for i > I and e > 0. Let c > 0. Then 

s-l 

> ^ W£ + CWi , 

for s > log2+e(c/e) +2. 

Proof. Clearly Wi > X^fci "^i ^'^^ *i ^.nd thus 

s-2 s-l s-l 

Ws > {2 + e)ws-i > Ws-i + wi + eWs-1 > we + e(2 + ey~'^wi > + cwi . 

e=i e=i 1=1 

□ 

Lemma 32. Let z he the solution of Lz = e,;, and let s > be sueh that \zs\ > 
Yfi=i\zi\- Then \z„\ > J2'i=i l^^b a"*^ sgn(z„) = sg-n{zs). 

Proof. The proof is a simple induction argument. Let j > s, and /c = jajj. li £ < i 
then zi ~ 0. Hence our assumption implies that s > i, and thus j > i. We then have 
the equation 



= 



which means 

ae£Fj\{aj-i,aj} 

We treat the case of > 0; the case of Zs < is analogous. By induction we can 
estimate 

z, > (2^-1 - - ^|z,| > (2'=-! - 2)z,_i > Y,\z,\ , 

e=i 1=1 
since /c > 3. □ 
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5 Explicit matrices of almost worst case patience 

Below we state as an example the matrices L (with zero entries omitted), A, and 
A~^, for m = 4. 



L = 



1 












1 

1 

1 

1 








1/2 


1/2 -1/2 
1/2 1/2 

1/2 1/2 
1/2 1/2 

1/2 1/2 
1/2 1/2 


1/2 
-1/2 1/2 

-1/2 1/2 

-1/2 1/2 

-1/2 1/2 

-1/2 1/2 






1/4 


1/4 1/4 1/4 
1/4 1/4 

1/4 1/4 

1/4 1/4 


1/4 1/4 -3/4 
1/4 1/4 1/4 1/4 

1/4 1/4 1/4 1/4 
1/4 1/4 1/4 1/4 


1/4 
-3/4 1/4 

-3/4 1/4 

-3/4 1/4 






1/8 1/8 1/8 1/8 


1/8 I/S Vs VS Vs Vs 


1/8 1/8 1/8 -7/8 


Vs. 



A = 



"1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1" 


1 


-1 


1 


1 


1 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


-1 


-1 


1 


1 


-1 


1 


1 


1 


-1 


1 


1 


-1 


-1 


-1 


1 


-1 


-1 


-1 


1 


1 


1 


-1 


1 


1 


1 


-1 


-1 


1 


-1 


-1 


-1 


1 


-1 


-1 


1 


1 


1 


1 


-1 


-1 


-1 


-1 


1 


1 


1 


-1 


-1 


-1 


1 


-1 


1 


-1 


1 


1 


1 


1 


1 


1 


-1 


-1 


1 


1 


1 


1 


-1 


1 


1 


1 


-1 


1 


1 


-1 


1 


1 


1 


-1 


-1 


1 


-1 


-1 


-1 


-1 


1 


1 


1 


-1 


1 


1 


-1 


1 


-1 


1 


-1 


-1 


1 


-1 


-1 


-1 


1 


-1 


1 


1 


1 


-1 


1 


-1 


1 


-1 


1 


-1 


-1 


-1 


1 


-1 


1 


1 


-1 


1 


1 


1 


-1 


1 


-1 


1 


-1 


-1 


-1 


1 


-1 


-1 


1 


1 


1 


-1 


1 


1 


1 


-1 


-1 


-1 


1 


1 


-1 


-1 


-1 


-1 


1 


1 


1 


1 


-1 


-1 


1 


1 


1 


1 


-1 


-1 


1 


1 


-1 


-1 


1 


-1 


1 


1 


1 


1 


-1 


-1 


1 


-1 


-1 


1 


-1 


-1 


-1 


1 


1 


1 


-1 


1 


1 


-1 


1 


-1 


-1 


1 


-1 


-1 


1 


-1 


-1 


1 


1 


1 


1 


-1 


1 


-1 


-1 


-1 


1 


-1 


1 


-1 


-1 


1 


-1 


1 


1 


1 


1 


1 


-1 


1 


1 


1 


-1 


-1 


-1 


-1 


-1 


-1 


1 


1 



22 



5 Explicit matrices of almost worst case patience 



-2 


-95 


-117 


-195 


-108 


-50 


-30 


50 


110 


136 


142 


108 


36 


12 


4 


1 


1 


91 


114 


192 


108 


52 


32 


-48 


-108 


-134 


-140 


-107 


-36 


-12 


-4 


-1 


1 


90 


112 


189 


106 


51 


31 


-47 


-106 


-132 


-138 


-105 


-35 


-12 


-4 


-1 


1 


85 


106 


178 


100 


48 


29 


-45 


-100 


-124 


-130 


-99 


-33 


-11 


-4 


-1 


1 


69 


86 


145 


81 


39 


24 


-36 


-81 


-101 


-106 


-81 


-27 


-9 


-3 


-1 





-67 


-84 


-143 


-81 


-40 


-25 


35 


80 


100 


105 


80 


27 


9 


3 


1 





-65 


-82 


-139 


-79 


-39 


-24 


34 


78 


97 


102 


78 


26 


9 


3 


1 





-60 


-76 


-129 


-73 


-36 


-22 


32 


72 


90 


94 


72 


24 


8 


3 


1 





-82 


-103 


-175 


-99 


-49 


-30 


43 


98 


122 


128 


98 


33 


11 


4 


1 





-87 


-110 


-186 


-105 


-52 


-32 


46 


104 


130 


136 


104 


35 


12 


4 


1 





-80 


-101 


-172 


-97 


-48 


-30 


42 


96 


120 


126 


96 


32 


11 


4 


1 





57 


72 


123 


70 


35 


22 


-30 


-69 


-86 


-90 


-69 


-23 


-8 


-3 


-1 





59 


75 


127 


72 


36 


22 


-31 


-71 


-89 


-93 


-71 


-24 


-8 


-3 


-1 





64 


81 


138 


78 


39 


24 


-34 


-77 


-96 


-101 


-77 


-26 


-9 


-3 


-1 





78 


99 


169 


96 


48 


30 


-41 


-94 


-118 


-124 


-95 


-32 


-11 


-4 


-1 





-57 


-72 


-122 


-69 


-34 


-21 


30 


68 


85 


89 


68 


23 


8 


3 


1 



5.4 First column 

We first solve the equation Lz = e\. By induction we show that Zj = \ — k, whenever 
\aj\ = k. For the base case, clearly zi ~ 1, since the first row of L is ej. Next for the 
induction step we treat the cases oi k = 1 and k > 2 separately. 

Let \aj\ = 1. When j = ii = 2, wc have A2 = {!}, and hence F2 = {ai, 012}. When 
j > ii = 2, we have A2 = {j — 2,j — 1}, and hence Fj — {aj^i, ctj}. In both cases we 
actually have Fj \ {aj-i,aj} ~ ^. Thus 

z, = (21-1 _ _ ^ ^ ^ 

ae£Fj\{aj-i,aj} 

Let \aj\ = k > 2. Consider first j = ik- We have \Aj \ — \aj\ — k, and Fj contains 
(^) sets of size s. By the induction hypothesis we have 

z, = (2^-1 - l)z,_i - ^ 

ae&Fj\{aj-i,aj} 
fc-2 







(fc- 


1))- 


(2fc-i 


-1)(2- 


k)- 


k 

E( 

s=0 


(2fe-i 


-1)(2- 


fc)- 


(2- 



s=0 
k' 



■)fc-l 



Consider next j > ik- Wc have \Aj \ — k+1, and Fj contains 2(^ :[) sets of size s > 0. 
In particular Fj contains only the sets aj and ctj-i of size k. Again by the induction 
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hypothesis we have 



ai£Fj\{aj-i,aj} 







fc)- 


s=0 ^ 






fc)- 






-1)(1- 


k)- 


f 2(fc - 1)2'=" 



(i-G'^ + i)) 

s - 2{k - 1) 



5.4.1 Sign pattern 

Next we compute a; = -Qz. We need the following well-known identity ([7| Equation 
5.42]) 

Lemma 33. Let P{a) = cq + cia + • • • + Cfea'^ be a polynomial, k > 0. Then 

k 



j2(%-^Tn<^)^{~^fk\cu 



□ 

Consider given j, and let k = \aj\. Then 

= -E(-l)'"^^"''^^ ^ _^(_i)l".nad(i _ 1^,1) (7) 

i=0 1=0 

For given i, let a = |aj H a^j and b = ja^j — a. Then we may collect the terms in 
Equation ([7]) according to a and b and obtain 



We first evaluate the innermost summation 

m—k / J \ m — k / j \ m — k / , ■ 

s •"-^)(i-a-.)=(i-a)i: --Vi:'^"-' 

6=0 ^ ^ 6=0 ^ ^ 6=0 

= (1 - a)2"'-'= - (m - A:)2'"-'=-i - (m - /c)/2 - a) 

Thus, 

X, = 2-'= ^ {-ini {m k)/2 a) 

a=0 ^ ^ 

By Lemma [33l wc have xi = 1 — m/2, since |q;i| = 0, Xj — 1/2, for k — \aj\ — 1, and 
Xj = when k = \aj\ > 1. 
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5 Explicit matrices of almost worst case patience 
5.5 Second block 

Here we consider the equation Lz = Ci, for \ai\ = 1. The last column of the block is 
handled separately. In this and the following sections we shall use the notation as 
a shorthand for the entry 2num(a)- 

5.5.1 First m — 1 columns 

We have zi = 0, since the first row of L is ej. Next, Zj = for j e {2, . . . , m + 1} \ {i}, 
and Zi = 1, since row j of L is eJ for all j G {2, . . . , m + 1}. 
For j — 12 we have the equation 

i(z0 + Z{i} + (1 ~ 2)z{m} + = , 

since Ai.^ = {1, m}, and Fi^ = {0, {1}, {m}, {1, m}}. We assume here that i < m + 1 = 
nuni({m}), and thus have = —z^ij. Thus Zi^ = when i > 2, and Zi^ = —1 when 
1 = 2. For 12 < i < ia we have \aj A Q!j-i| ~ 2. Let A aj-i = {a, Then 
Fj = {{a}, {6}, ttj-i, ctj} and we have the equation 

liHa] + Z{b} + (1 - 2)Zj-l + Zj) = . 

Hence z^ = Zj-i — 1 if i S A aj-i, and Zj = Zj-i otherwise. 

Note that any element of {2, . . . , m— 2} appears 2 times in the symmetric differences 
aj-i A aj for 12 < j l£ num({m — 1,to}), whereas the elements 1 and m — 1 appear 
only 1 time. Hence it follows that Zj-^ „j_2i. and Z{m.m-i} ^-rc both at least —2. 

Note that when to > 6, any element of {2, . . . , to — 1} appears at least 4 times in 
the symmetric differences a^-i A a-,- for 12 < j < is, whereas the clement 1 appear 
exactly 3 times. In both cases this implies by the above that 2^3-1 < —4. 

Consider now j = i^. Then Aj = {to — 2, to — 1, to} and Fj = {0, {to — 2}, {m — 
1}, {to}, {to — 2, to — 1}, {to — 2, to}, {to — 1, to}, {to — 2, to — 1, to}}, and we thus have 
the equation 

-(Z0 + Z{„j_2} + Z{„j_i} + Z{„j} + Z{m-2,m} + Z{„i-l,m} + (1 ^ 4)Zi3_i + Z^g ) = , 

and hence z^g = Sz^g-i — 2{„j „j_2} — Z{„ „j_i}, when z ^ {to — 2, to — 1}, and z^g = 
3zi3_i - Z{„^„i_2} - Z{m,m-i} " 1, Otherwise. In both cases Zi^ < 3zj3_i - Z{„,,„_2} - 
Z{m,m-i}- We already have the estimates Zi3_i < —4, and Zf^rn,m-2}, Z{m,m-i} > ^2. 
Hence Z{„ „i_2} + Z{rn,m~i} > -4 > Zi3_i, and it follows 

Zi3 < 2zi3_i < -8 . 

Next consider j = is + 1. Then Aj = {to — 3, to — 2, to — 1,to}, but the set 
Fj depends on whether to is even or odd. Write Aj = {m — 3, to — l,a, 6}, where 
A (2^3+1 = {to — 3, a}. Then Fj = {{to — 3}, {a}, {to — 3, m — 1}, {jti — 3, 6}, {a, to — 
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1}, {m — 2, m}, {m — 3, m — 1, &}, {m — 2, m — 1, m}}. Let /3i, . . . , ^4 denote the sets 
of size 2 of . We then have the equation 

+ Z{a} + Zp, + Zp^ + Zp^ + Zp^ + (1 - 4)Zj3 + Zjj + i) = 

and hence ^lig+i = 32:^3— ^^^j^ z^^, when i ^ {m— 3, a}, and 2:43+1 = 32^3— ^^^j^ z^^ — 1, 
otherwise. In both cases 2:^3+1 < 3zj;3 — ^Ps- seen 2{m-2,m} > ^2 > ^Zi^-i, 

and for the other /3s we have z^^ > Zi3_i. Thus 

1 115 

2J3+1 < 3Zi3 - (3 + -)Z,3_1 < 3Z,3 - (3 + 2) 9^»3 = ^2^3 ■ 

For the remaining j = i^+i+l, £ > 0, for which |aj| = 3 we have the similar inequahty 

^ 8 

^13+^+1 — 3zi3+f — > zp^ < 3zi3+f — 4zi3_i < 3zi3+£ — 2zi3 < 3zi^^£ — -rZig+i , 

s=l ^ 

for appropriate sets Pi, ... ^ 13 ^ of size 2. 

Claim 34. For j ^ + £ + 1, £ > 0, for which \aj\ ^ 3 we have 

3^ + 4 

Zis+e+i < ^j— j— j-^Zj3+^ 

Proof. The proof is by induction on £. For £ = 1 we have 

8 _3 + 4 

^13+2 S 0^13 + 1 ~ -Zis + lZi^ + l — — — Zi3 + l . 

5 1 + 4 

Next, for the induction step 

3"-i + 4 \ 



Zi3+e+i < Szi^+i - g^i3+i < 3zi3+f ~ 5 ( n 3s + 4 

\s=l 

_,o 8 5 , 3^ + 4 



Zi3+e 



□ 



We next find s such that 

13+8-1 



Zi 



We estimate the first 13 + 3 terms separately. Wc have at most 1 + m(m — l)/2 + 4 
nonzero terms, each of absolute value less than |zi3+4|. That is 

23+3 

^|Z^| < TO^|Z,3+4| , 
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using m > 6. 

Using Claim [Ml observing that J-tj^^^^ is increasing with £, and gl-j"^^ > f , we can 
apply Lemma [HH with Wi = \zi^+3+i\, c = m^, e = h to obtain 



is+s-l 



for s — log5/2(2?7i^) + 5. Note that + s < i^, since there are (™) sets of size 3, and 
TO > 6. Also by Claim l34l we have that z^g+s < 0. By Lemma l32] we thus have 

n-l 

Zn < - X^l^^l ■ 

5.5.2 Last column 

Here we consider the last column of the second block, corresponding to solving the 
equation Lz = Ci^-i. As above we have zi — 0, and Zj = for j G {2, . . . ,to}, and 
Zi2_i = 1. For j ~ 12 we have the equation 

^(^0 + ^{1} + (1 - 2)2:|„} + ZjJ , 

since Ai^ = {1,to}, and Fi^ = {0, {!}, {to}, {1, m}}. It follows that Zi^ ~ 1. Also as 
above for 12 < j < 13, Zj = Zj^i if to e 0;^ A aj-i, and Zj = Zj^i otherwise. All sets of 
size 2 containing the element to comes before all other sets of size 2 in the order, and 
hence the case of m G aj A ctj-i occurs only when j — num({TO, to — 1}) + 1 = 2to + 1. 
Thus we have Zj = 1 when 12 < j < 2to and Zj ~ when 2to < j < i^. 
For j ~ ia, we have the equation 

-(Z0 + Z{„j_2} + ^{m-1} + Z{,„} + Z|„_2,m} + Z{m-l,m} + (1 ^ 4)Zi3_i + Z^g ) = , 

since again = {to — 2, to — 1, to} and Fj = |0, {to — 2}, {to — 1}, {to}, {to — 2, to — 
1}, {to — 2, to}, {to — 1, to}, {to — 2, TO — 1, to}}. From this we see that z^, = —3. 
For ia < j < ii we have 

Zj = (2^-1 - l)z,_i - ^ Zi< 3z,_i , 

aeeFj\{aj-i,aj} 

and also Zj < 0. Again we find s such that 

\zi,+s\ > l^''! ■ 

e=i 

Note that X^ftJi^N^I = I + {m — 1) = to. We can then apply Lemma [5T] with Wi = 
|zi3+i_i|, c = TO, e = 1 to obtain 



13+8-1 

E 
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for s = log3(m) + 2, noting that + s < i^. We also have Zi^^s < 0. By Lemma [32] 
we then have 

Zn < - ■ 
1=1 

5.6 Third block 

Here we consider the equation Lz = e^, for \ai\ — 2. We have Zj = for j < Zi = 1, 
and hence zj = (2^-1 - - Ea,Gi=^A{".-i,".} " ^' * < J < *3- We remark 

for future use that X^fc'i^k^l — (T)- 

Consider now j = ^3 . As usual we have the equation 

-(Z0 + 2{„i_2} + 2{m-l} + 2{m} + ^{m-2,m} + ^{m-l,m} + (1 ~ 4)zi3_i + Z^g ) = , 

and hence 

^13 32^^3 — 1 ^{m — 2,m} ^{m— l,m} ^ ^{m — 2,m} ^{m — l,m}- 

Next consider j = is + 1. As above = {m — 3, 7ti — 2, m — 1, m}, where the set Fj 
depends on whether m is even or odd. Write again Aj = {m — 3, m — 1, a, 6}, where 
Qfig A Qfig+i = {to — 3, a}. Then Fj = {{to — 3}, {a}, {to — 3, to — 1}, {to — 3, b}, {a, to — 
1}, {to — 2, to}, {to — 3, to — 1, b}, {to — 2, to — 1, to}}. Let . . . , /34 denote the sets 
of size 2 of . We then have the equation 

^(^{m^3} + Z{a} + ZfS, + Zfs^ + Zp^ + Zf;^ + (1 - 4)z,3 + 2:^3 + 1) = , 

and hence 2:i3+i = 32:13 — ^Ps- We consider below 3 cases depending on the 

relationship between i and num({TO — 2, to}) = 2to — 1. 

• i < num({TO — 2, to}): Here Zi^ = 1. Also in our ordering, for s € {1, ... ,4} 
we have num(/3s) > num({TO — 3, to}) > i. It follows that Zi3+i = —1. For 
i3 + K i < ii, we have zj = (2^-1 - l)zj^i - Ea^eFA{a,-i,a,} ^« < We 
can thus apply Lemma [311 with Wi = jzig+ij, c = to^/2, e = 1 to obtain 

is+s-l 

for s = log3(TO^/2) + 2, noting that 13 + s < ^4. We also have 2^3+5 < 0. By 
Lemma l32] we then have 

n—l 

Zn < - 'Y\ze\ ■ 
e=i 
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• i = num({m — 2, m}): Here = 1 as well. In case a = m we have Zi^+i = —1. 
Also 

< (2^^^ - l)2i3+i - X! - ^-^^s+i = -3 . 

However in case a = m — 2 we have Zig+i = 0. Thus we consider j = 1^ + 2 as well. 
We have here that aj = {m — 3, m — 2, m} and thus aig+i A 0^3+2 = {"i — 1, m}. 
Then 

^43+2 ^{m — 3,m— 1} ^{m — 2,m— 1} •^■{Tn— 3,Tn} ^{rn— 2,rn} 3 

For ^3 + 2 < J < 14, we have as before < 3zj_i, and can thus apply Lemma [311 
with Wi — |zi3+i+i|, c — m^/2, e = 1 to obtain 

13+8-1 
£=1 

for s — log3(m^/2) + 3, noting that + s < 14. We also have Zi^+s < 0. By 
Lemma l32] we then have 

n-l 

Zn < - X^l^'^l ■ 

£=1 

• I > num({TO— 2, m}): Here > 2. Since num({m— 2, m}) < num({m— 1, m}) < 
I we have 2:^3+1 = 3zi3 — zp^ > 3zi3 — 3 > §2:^3. Let ■ ■ ■ , P^'' denote 

4 > |zi3+i. Again, let ^ . . . denote the sets of size 2 of -Fia+s. Then 
2;j3+3 = 3z^3+2 - Z]t=i -2^(3) > T^»3+2 + I • f ■ - 4 > ^2;,3+2- By induction 
it is now easy to derive Zj > ^Zj-i for is + 3 < j < 14. We can thus apply 
Lemma [5T] with Wi = Zi^+i+i, c = m^/2, e = ^ to obtain 

i3+s — 1 



the sets of size 2 of i^i3+2. Then 0^3+2 = 3zi3+i - J2t=i ^^t^) - §^^3+1 + 2^1; 

5 ... . A„o;„ a(3) 



for s = logii (m^/2) + 3, noting that + s < i^. We also have Zi^+s > 0. By 
Lemma [5^ we then have 



Zn > y^,\zi\ 



e=i 

5.7 Remaining columns 

Here we consider the equation Lz ~ e^, for \ai\ = fc > 3. We then have that Zj — for 
j < i, Zi ~ 2*^^^ > 4. Clearly Zi > X]«=il-^^l — 0- Lemma 15^ we then have 

n-l 

Zn > X^l^^l ■ 
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5.8 Explicitness 

Wc discuss here in more detail the exphcitness of our construction. We say that a 
family {A„} of matrices, where An is a n x n matrix, is explicit, if there is an algorithm 
that given as input n computes the matrix An in time polynomial in n. We say that 
the family is fully- explicit, if there is an algorithm that given as input i, j, and n, 
computes entry (i,j) oi An in time polynomial in log(n). Clearly the latter definition 
is more restrictive than the former. 

We next give a sketch of an argument that the matrices just constructed are fully- 
explicit. Let A be the 2™ x 2™ matrix of Section [5TT] with the order of Section [^21 
and let B be the 2™ x 2™ matrix obtained by the Hadamard product of A with the 
transpose of the sign pattern E of Section 15.31 In order to compute entry {i,j) of B 
we compute separately the entry (i, j) of A and the entry {j,i) of E. 

To compute entry (j, i) of E we need to determine which block of rows that row j 
belongs to and to check whether i > 2m — 1 . The former is determined by finding k 
such that 

This is easily done in time polynomial in m. 

To compute entry of A it is sufficient to observe that the following task can 
be computed in time polynomial in m: Given index i, compute the set of the order, 
ai. To do this, first compute the k such that \ai\ — k. This is the same task as just 
considered, and identifies the order Depending on k we may need to consider the 
reverse of this. By appropriately adjusting i, we may just consider consider finding 
the set i' of the order (for fc = 2 we also need to shift the set afterwards). This 
can be done by first identifying the smallest element a of the set a,' and recursing. 
Specifically, a can be determined by the inequalities 

|:(r:0<-'4(r:0- 

Then i' is adjusted by subtracting the sum X^fci {^-i)t ^^'^ continuing with /3^^^ai 
possibly adjusting i' again if the order is reversed, finding the next-smallest element 
and so on. 
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